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Abstract — We propose a new inner bound on the capacity 
region of a memoryless multiple-access channel that is governed 
by a memoryless state that is known strictly causally to the 
encoders. The new inner bound contains the previous bounds, 
and we provide an example demonstrating that the inclusion can 
be strict. 

A variation on this example is then applied to the case where 
the channel is governed by two independent state sequences, 
where each transmitter knows one of the states strictly causally. 
The example proves that, as conjectured by Li et al, an inner 
bound that they derived for this scenario can indeed by strictly 
better than previous bounds. 

I. Introduction 

If a memoryless single-user channel is governed by an 
independent and identically distributed (IID) state sequence, 
then its capacity is not increased if the state is made available 
to the encoder in a strictly-causal way. The picture changes 
dramatically on the multiple-access channel (MAC) [T|, Q: In 
the "single-state scenario," where the channel is governed by 
a single state sequence, the capacity region typically increases 
if the state is revealed to both transmitters in a strictly causal 
way [1|. Some of the gains can be attributed to the ability 
of the two encoders to compress the state information and to 
cooperate in sending the compressed version to the receiver. 
But strictly-causal side information (SI) is beneficial even in 
the "double-state scenario," where the channel is governed by 
two independent states, with each transmitter knowing one 
of the sequences strictly causally. In this case too, the side 
information can be helpful even though the transmitters cannot 
cooperate in compressing the states or in sending them 02]. 

The present note deals with both the single-state and 
the double-state scenarios. For the single-state scenario, we 
present a new inner bound on the capacity region. This bound 
contains the inner bound of JT] (which was extended to 
the many-transmitters scenario in |]3]). We also provide an 
example showing that the inclusion can be strict. 

By adapting this example to the double-state scenario, we 
provide an example showing that — as conjectured in [3| — the 
inner bound proposed by Li et al. in J5) can be strictly larger 
than that in 0. 

To keep the contribution focused, we do not consider causal 
side information in this note, although our results can be 
carried over to that setting as in JT], |]2]. 



We next describe the two scenarios more explicitly. Our 
descriptions are identical to those in (TJ, except that, for 
simplicity, we do not consider cost constraints and we assume 
throughout that all the alphabets are finite. 

A. The Single-State Scenario 

In the single-state scenario we are given a discrete mem- 
oryless state-dependent MAC of law Py\w,Xx,x 2 w i tn state 
alphabet W, state probability mass function (PMF) Pw, input 
alphabets X\ and X 2 , and output alphabet y. Sequences 
of letters from W are denoted w n — (w%, w 2 , ■ ■ ■ , w n ) 
and w\ — (wi,Wi + i . . . ,Wj). Similar notation holds for 
all alphabets, e.g. x\ = (xi,i, 2:1,2, £i,n)> x 2 .i = 
(%2,i> ^2,1+1) • • • > %2,j)- When there is no risk of ambiguity, 
n-sequences will sometimes be denoted by boldface letters, y, 
Xi, w, etc. The laws governing n-sequences of output letters 
and states are 

n 

P Y\W,Xi ,X 2 (y| w > x l ' X 2) = II P Y\W,X lt X 2 (Vi\Wi, X X ,i,X 2 ,i), 

t=l 

n 

PwM = l[Pw(wi). 

i=l 

For notational convenience, we henceforth omit the super- 
script n, and we denote the channel by P. 

Definition 1: Given positive integers v\, v 2 , let hA\ de- 
note the set {1, 2, . . . , v\\, and let M. 2 denote the set 
{1,2,..., v 2 }. An (n, vi, v%, e) code with strictly-causal side 
information (SI) at the encoders is a pair of sequences of 
encoder mappings 

fk,% : W <_1 x Mk —> fc = l,2, i=l,...,n (1) 

and a decoding mapping 

g: y n ^MiX M 2 

such that the average probability of error P e does now ex- 
ceed e. Here P e is 1 — P c ; 
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Pr(correct|mi, 7712); 



and 



The rate pair (Pi, P 2 ) of the code is defined as 



Pr(correct|mi, m 2 ) 



Pi 



E 



P w (w)P (g 1 (m 1 ,m 2 )|w,f 1 (w,mi),f 2 (w, m 2 )) , 



log v x , 



R-2 



logi/ 2 - 



where g 1 (mi,m 2 ) C y n is the decoding set of the pair of 
messages (mi,m 2 ), and 

fk(w,m fc ) = (fks( m k), /fc,2(wi,m fc ), . . . ,/fc,„(w n_1 ,m fe )). 
The rate pair (Pi, P 2 ) of the code is defined as 

Pi = - log vx, R 2 = - log 1*2. 
n 71 

A rate-pair (Ri, R2) is said to be achievable if for every posi- 
tive e and sufficiently large n there exists an (n, 2 nRl , 2 nR2 , e) 
code with strictly-causal SI for the channel iV1w.X1.X2- The 
capacity region of the channel with strictly-causal SI is the 
closure of the set of all achievable pairs (Pi,P 2 ), and is 
denoted C)r° m . The subscript "s-c" stands for strictly-causal. 

B. The Double-State Scenario 

In the double-state scenario we are given a discrete memory- 
less state-dependent MAC Py\s 1 ,s 2 ,x 1 ,x 2 with state alphabets 
Si and S 2 , state probability mass functions (PMFs) Ps 1 and 
Ps 2 , input alphabets X\ and X 2 , and output alphabet y. The 
laws governing n sequences of output letters and states are 

p y\s u s 2 ,x u x 2 (y|sis 2 ,xi,x 2 ) 

n 

= II Py\Si,S 2 .X u X 2 (Vi\si,i, S 2 ,i, X lt i,X2,i), 
i=l 

n 

P£ iS >l,S 2 ) =HP Sl (si,i)Ps 2 (s2,i)- 
i=l 

For notational convenience, we henceforth omit the super- 
script n, and we denote the channel by P. 

Given positive integers i>\, v 2 , let Mi be the set 
{1,2,..., vi) and M. 2 the set {1,2,..., v 2 }. An (n, v\, v 2l e) 
code with strictly causal independent SI at the encoders is a 
pair of sequences of encoder mappings 

/*,<: x M k ^ X k , fc = l,2, i = l,...,n (3) 
and a decoding mapping 

g: y n -->Mi x M 2 

such that the average probability of error P e is bounded by e, 
where P P = 1 — P.. and 
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VlV 2 
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E 



mi — 1 7712 — 1 Si ,S2 

P Sl (si)Pg 2 (s 2 )P(g -1 (mi, m 2 )|si, s 2 , fi(si, mi), f 2 (s 2 , m 2 )) 

where (7 _1 (mi,m 2 ) C is the decoding set of the pair of 
messages (mi,m 2 ), and 

ffc(sfc,TOfc) = (f k ,i(m k ), f ki2 (s k ,i,m k ), . . . ,/k, n (Sfc~\mfe)). 



A rate-pair (Ri,R 2 ,) is said to be achievable if for every 
e > and sufficiently large n there exists an (n, 2 nRl , 2 Ili?2 , e) 
code with strictly-causal SI for the channel Py\s,Xi,x 2 - The 
capacity region of the channel with strictly-causal independent 
SI is the closure of the set of all achievable pairs (Ri,R 2 ), 
and is denoted C£J?- The superscript "ind" indicates that the 
two states are independent. 

II. The Single-State Scenario 

For the single-state scenario, an inner bound on Cjr° m was 
derived in [ 1 1 and later extended to many-transmitters in |]3]. 
In the absence of cost constraints this bound can be described 
as follows: Let P s c ° m be the collection of all random variables 
(U, V, Xi,X 2 , W, Y) whose joint distribution satisfies 

Pu,v,x t ,x 2 ,w,Y = PwPx 1 \ijPx 2 \uPuPv\wPy\w,x 1 .x 2 - 

(4) 

Note that d_TJ implies the Markov relations Xi^>— U^>— X 2 
and V~o— W~o— Y, and that the triplet (Xi,U,X 2 ) is in- 
dependent of (V,W). Let P™ m be the convex hull of the 
collection of all (Ri,R 2 ) satisfying 



Pi 
Pi 



Pi < I(X V ,Y\X 2 ,U,V) (5a) 

P 2 < I(X 2 ;Y\Xi,U,V) (5b) 

R 2 <I(X 1 ,X 2 ;Y\U,V) (5c) 

R 2 <I(X 1 ,X 2 ,V-Y)-I(V;W) (5d) 



}Com 
s-c " 



for some (U, V, X t ,X 2 , W, Y) e VI 

Theorem 1 (SB): P™ m C C™ m . 
The achievability of this region is based on a Block-Markov 
scheme where at Block v + 1 the transmitters send fresh 
private messages as well as a common message that is used to 
send a compressed version of the state sequence of Block v. 
The compression is of the Wyner-Ziv type with the side 
information being the channel outputs at Block v. 

We next present a tighter inner bound. At Block v + 1 
we still use the MAC by sending private messages and a 
common message. The common message is still a compressed 
version of the state information from the previous block. 
The twist, however, is that the private messages need not be 
entirely composed of fresh information. The private message 
of Transmitter 1 has two parts. The first, of rate Pi, is 
indeed fresh information. But the second, of rate Pq 1 ', is a 
compressed version of the pair of sequences (xi , w) from 
Block v (again with the side information being the received 
symbols in the previous block). Since Transmitter 1 knows 
which symbols it sent in the previous block, and since it knows 
the state of the channel in the previous block, it can compress 
the pair (xi,w). Likewise Transmitter 2. Using Gastpar's 
results on the compression of correlated sources with side 
information |4| we obtain the following bound: 



Theorem 2: The rate-pair {R\ , R 2 ) is achievable if for some 
joint distribution of the form 

Pu.y,v 1 .y 2 ,x 1 ,x 2 ,w,y = 
Pw Pxi 1 u Px 2 \uPuPv\w Pvi \w,Xi Pv 2 \w,x 2 Py\w,x 1: x 2 (6) 

there exist nonnegative numbers and R Q 2 ^ such that 

Ri + R ( o ] < HXi; Y , Vi, V 2 , V\X 2 , 17) (7) 
R 2 + R { o ) <I{X 2 -Y,V 1 ,V 2 ,V\X U U){%) 
Ri + R 2 + R ( o ] + R ( o } < I(X 1 ,X 2 ;Y, V U V 2 , V\U)(9) 

Ro + Ri + R 2 + R i Q 1) +R { o } < I(X 1 ,X 2 - Y, V X ,V 2 , V) (10) 

and 

R^ > liX^WiV^V^Y) (11a) 
R ( o } >I(X 2 ,W;V 2 \V,V!,Y) (lib) 
Ro>I(W;V\V u V 2 ,Y) (He) 
4 1) +- R o 2) >I(X u X 2 ,W;V ly V 2 \V,Y) (lid) 
R { 1] +Ro>I(X 1 ,W;V 1 ,V\V 2 ,Y) (lie) 
R ( o 2) +i?o > I(X 2 ,W;V 2 ,V\V U Y) (llf) 
i4 1) +i^ 2) +i2o>/(X 1 ,X 2) W;V lj V r 2) V|y). (llg) 

If we only consider joint distributions where V\ and V 2 are 
deterministic, and if we set R^\ R^ to zero, we obtain the 
inner bound of [ 1 1. Thus, 

Remark 1: The proposed inner bound contains the inner 
bound of [Q 

The following example shows that the inclusion can be strict. 

Example 1: Consider a MAC with two binary inputs X\ — 
X 2 = {0,1}; a common state W = (W ,Wi) G {0,1} 2 , 
where Wo, W\ are IID with entropy 

H(W ) = H(Wi) = 1/2; (12) 

and an output Y = (Yi,Y 2 ) G {0, l} 2 with 

Yi = Xx ® W X2 (13a) 
Y 2 = X 2 . (13b) 

Thus, if X 2 is equal to zero, then Y\ is the mod-2 sum of X\ 
and Wq, and otherwise it is the mod-2 sum of X\ and W\. 
We study the highest rate at which User 2 can communicate 
when User 1 transmits at rate 1. We show that for this channel 

max{i? 2 : (1, R 2 ) G K° c ra } = (14) 

but 

max{i? 2 : (1, R 2 ) G C™ m } = 1/2, (15) 

and that the rate-pair (1, 1/2) is in the new inner bound. 

Proof: We first prove (fT5T >. To this end we note that if 
(1,R 2 ) is achievable, then R 2 cannot exceed 1/2. This can 
be shown using the full-cooperation outer-bound 0], which 
implies that (Ri,R 2 ) can only be achievable if Ri+R 2 < 3/2. 
Of more interest to us is the fact that the rate-pair (1, 1/2) is 



achievable. We demonstrate this using the new inner bound. 
Indeed, it is straightforward to verify that setting 

R$P = Ro = 0, R { 2) = 1/2, (16a) 

V = Vi=0, V 2 = W X2 , (16b) 

U = 0, (16c) 

X lt X 2 - IID Bernoulli 1/2, (16d) 

and 

(Ri,R 2 ) = (1,1/2) (16e) 

satisfies all the required inequalities. This choice corresponds 
to the following Block-Markov scheme: In the Block-Markov 
scheme Transmitter 1 sends its data uncoded. At Block 6 + 1 
Transmitter 2 sends n bits, half of which are fresh data bits 
and half of which are used to describe the n-length sequence 
w X2 of the previous block. Note that Transmitter 2 does not 
describe the entire state sequence w of the previous block 
but only w X2 . This latter sequence is known to Transmitter 2 
at the beginning of Block b + 1 thanks to the strictly-causal 
state information and because it knows the sequence x 2 it 
transmitted in the previous block. And n/2 bits suffice to 
describe this sequence because Wx 2 is of entropy 1/2. 

We now turn to proving (fl4l >. We fix some distribution 
Pjj,v,x 1 ,x 2 ,w,y of the form dU, we assume that (Ri = 1, R 2 ) 
satisfy Inequalities (|5), and we then prove that R 2 must be 
zero. Since R± = 1 and since X\ is binary, Inequality (Bal l 
must hold with equality, and X\ must be independent of 
(X 2 , U, V). By ©, this implies that 

Xx is independent of (X 2 , U, V, W). (17a) 

From (T5ab (that we know holds with equality) and the fact that 
Ri = 1 we also infer that 

1 = H(Y\X 2 , U, V) - H(Y\X 1 ,X 2 , U, V) 
= H(Yx\X 2 , U, V) - H{Xx\Xx,X 2 , U, V) (17b) 

where the second equality holds because Y 2 is a deterministic 
function of X 2 . Since Y% is binary, H{Y\\X 2 , U, V) is upper- 
bounded by 1, and we conclude from (I17bb that 

= H(Y 1 \X 1 ,X 2 ,U,V) 
= H(Y 1 ®X 1 \X 1 ,X 2 ,U,V) 
= H(Wx 2 \X 1 ,X 2 ,U,V) 
= H(Wx 2 \X 2 ,U,V) (17c) 

where the last equality follows from (1 1 7 at . 
We next show that 

U^-(X 2 ,V)^-Wx 2 - (17d) 

To this end we note that, by (0J, the pair (V, W) is independent 
of (U,X 2 ) and hence 

U^>-(X 2 ,V)^-W. (17e) 

Since Wx 2 is a deterministic function of (X 2 ,V,W), this 
implies ( 117dl i. because if A— o— B— o— C forms a Markov chain 



then A—o—B—o—f(B,C). Having established d!7d| ), we now 
obtain from ( I17cb 

H(Wx 2 \X 2 ,V)=0. (17f) 
We now focus on the case where X 2 is not deterministic 

Pr[X 2 = ?7 ]>0, 77 G {0,1}, (17g) 

because if X2 is deterministic then R2 must be zero by 
We also assume that the PMF of V is strictly positive 



Yr[V = v] >0, !)£ V, 



(17h) 



because outcomes of the auxiliary random variable that have 
zero probability can be removed from V without affecting the 
inner bound. Since , by (0), V is independent of X 2 , it follows 
from (|17g) and (117hl i that 



Pr[X 2 = »j,V = i;] >0, 77 G {0,1}, v G V. (17i) 
This and (fTTfb imply that 

ff(W J? |X 2 =r ?! F = «)=0, 77 G {0,1}, tjgV. (17j) 
Since, by (0), X 2 is independent of (V, VF) and, a fortiori, of 



(V, W^), it follows from ( |T7j] i that 

JT(W„|V = «) =0, 77 G {0, 1}, »eV. 
Thus, H(W V \V) = 0, and since W = (W , W\), 
H{W\V) = 0. 

Consequently, 



I(V;W) 



H(W) 
1, 



(17k) 



(171) 



(17m) 



where the second equality follows from (fT2l and the indepen- 
dence of Wq and W\. From (117ml >. (l5dl i, and the fact that 3? 
has four elements we then conclude that R\ + R 2 < 1. This 
combines with R\ = 1 to establish that i? 2 must be zero. ■ 
Terminating the Block-Markov scheme: To conclude the 
sketch of the achievability of the new inner bound, we still 
need to describe how the Block-Markov scheme is terminated. 
We thus assume that B blocks have been transmitted, and we 
proceed to describe Blocks B + 1, B + 2, and B + 3. We 
think about these blocks as "overhead," because they contain 
no fresh information. Fortunately, this overhead does not affect 
the throughput because we can choose B very large. 

The next lemma shows that if the full-cooperation capacity 
of the MAC without SI is zero, then the new inner bound 
contains only the rate-pair (0, 0) and is thus trivially an inner 
bound. 

Lemma 1: If the capacity of the MAC without any side 
information but with full cooperation is zero, i.e., if 



max I(X U X 2 ;Y) = 0, 

Px 1 ,x 2 



(18) 



then the proposed new inner bound contains only the all-zero 
rate tuple. 



Proof: By ( llgl and ( [Tol l, we conclude that if R±, R 2 is 
in the new inner bound, then for some joint distribution of the 
form © 

Ri + i? 2 

< I(X U X 2 ; Y, V u V 2 , V) - I{X X ,X 2 , W; Vi, V 2 , V\Y) 
= I(X U X 2 ; Y) + I(X 1 ,X 2 ; Vi, V 2 , V\Y) 
-I{X X ,X 2 ,W;V X ,V 2 ,V\Y). 

Consequently, if (fT8l holds and hence I(Xi,X 2 ;Y) 
is zero, then i?i + i? 2 must be upper-bounded by 
I{Xx,XnV x ,V 2 ,V\Y) -I{X 1 ,X 2 ,W;V 1 ,V 2 ,V\Y), which 
is nonpositive. ■ 

In view of Lemma[U it only remains to prove the achievabil- 
ity of the new inner bound when the full-cooperation capacity 
without SI is positive. The next lemma shows that we can also 
assume that the channel between Transmitter 1 (uninformed) 
and the receiver (informed) is of positive capacity and likewise 
from Transmitter 2. 

Lemma 2: If the channel between Transmitter 1 (unin- 
formed) to the receiver (informed) is of zero capacity, i.e., 

max max J(Xi; Y, W\X 2 = x 2 ) = 0, (19) 

x 2 ex 2 P Xl 

then the new inner bound contains only rate pairs (Ri,R 2 ) 
with Ri = and i? 2 < maxI(X 2 ;F). An analogous result 
holds if 



max maxI(X 2 ; Y, W\Xi 



Xi 



0, 



(20) 



Proof: We first prove that if a rate pair (i?i, i? 2 ) is in the 
new inner bound, and if (fT~9b holds, then Ri must be zero. 
Fix some joint distribution of the form (O and let (R±,R 2 ) 
satisfy the inequalities of Theorem [2] We next argue that 
Hypothesis ( fT9l implies 



I(X 1 ;Y,V 2 ,V\X 2 ,U)=Q. 



Indeed, 



i(x v ,y,v 2 ,v\x 2 ,u) 

< I(X i; Y,V 2 ,V\X 2 ,U,W) 
= I(X V ,Y\X 2 ,U,W,V 2 ,V) 
= I(X i; Y\X 2 ,U,W), 

= I(X i; Y,W\X 2 ,U), 

< max max I(X\ \ Y, W\X2 = x 2) U = u) 

u&A x 2 €X 2 

< max max max I(X\ \ Y, W\X2 — x 2 , U 

ueu x 2 ex 2 P Xl \u=u 



max max.I(X 1 ;Y.W\X i 

x 2 ex 2 p x , 



x 2 ) 



where the first line follows from 

X 1 ^-{X 2 ,U)^-W- 
the second from the chain rule and because 

X 1 ^-(X 2 ,U,W)^>-(V2,V) 



(21) 



(22a) 
(22b) 
(22c) 
(22d) 
(22e) 

u) (22f) 
(22g) 

(23) 
(24) 



so I{Xi] V 2 ,V\X 2 , U, W) is zero; the third from 

(X U Y)^(X 2 ,U,W)^(V 2 ,V); (25) 

the fourth again by (123k the fifth by upper bounding the 
average by the maximal value; the sixth by maximizing over 
the conditional distribution of X\ given U = u; and the 
last because the maximization over u on the RHS of ( 122ft 
is unnecessary. 

Continuing our proof that R x must be zero, we note that (0 
and dl lab imply 

Ri < I(X i; Y, V u V 2 ,V\X 2 , U) - I{X U W- Vi\V, V 2 ,Y) 
= I(Xi;Y, V 2 , V\X 2 , U) + I(Xr, Vx\X 2 , U, Y, V 2 , V) 

-I{Xx,W\Vi\V,V 2 ,Y) 
= I(X X ; V x \X 2 , U, Y, V 2 , V) - I{X X , W; V x \ V, V 2 , Y) 
= H(Vi \X 2 , U, Y, V 2 , V) - H{V X \X X ,X 2 , U, Y, V 2 , V) 

+H(V 1 \X X , W, V, V 2 ,Y)- H(V\ | V, V 2 , Y) 
= H{V X \X 2 , U, Y, V 2 , V) - H(Vx \X U X 2 , U, Y, V 2 , V) 

+H{Vx \Xi, W) - H{Vi \V, V 2 , Y) 

<o, 

where the second equality (third line) follows from (l2~fl . and 
where in the last inequality we have used 

H{Vx\X 2 ,U,Y,V 2 ,V) <H(Vi%V 2 ,Y) 

(conditioning reduces entropy) and 

H^Xx, X 2 , U, Y, V 2 , V) > HiV^X^W), 

which can be argued as follows: 

H(V X \Xt,X 2) U, Y, V 2 , V) > H{V X \X U W, X 2 , U, Y, V 2 , V) 

= H{Vx\X u W), 

where the first inequality is because conditioning cannot 
increase entropy, and the second by (|6), which implies that, 
conditional on (Xi,W), the auxiliary random variable V\ is 
independent of (X 2 , U,Y, V 2 , V). 

Having established that R\ is zero, we now conclude from 
( fTTjl i and (HUll 

R 2 = Ri + R 2 

< I{X X , X 2 ; Y, V x , V 2 , V) - I{X X , X 2 , W; Vi , V 2 , V\Y ) 
= I(X 1 ,X 2 ;Y) + 

I{Xx,X 2 ; Vx,V 2 ,V\Y) - I{X U X 2 ,W; V x , V 2 , V\Y) 
<I(X U X 2 ;Y) 
= I(X 2 ;Y) + I(X i; Y\X 2 ) 
= I(X 2 ;Y). 

■ 

Lemma |2] shows that if either ( fT9l > or (l20t holds, then the 
new inner bound is achievable. It thus only remains to prove 
its achievability when 

max max/(Xi; Y, W\X 2 = x 2 ) > (26) 

126^2 Px 1 



and 

max max/(X 2 ; Y, W\X X = x x ) > 0, (27) 
xieXi Px 2 

both of which we now assume. 

We are now ready to describe the termination of the Block- 
Markov scheme. Block B+l is split into two parts. In the first, 
Transmitter 1 sends the Vi -sequence of Block B assuming that 
the receiver knows the state sequence w of Block B + l. This 
can be done (under this assumption) by (|26| |. In the second, 
Transmitter 2 sends the v 2 -sequence of Block B assuming that 
the receiver knows the state of Block B + l. This is possible 
by ( |27"| |. In Block B + 2 the transmitters cooperate to send 
the sequence w of Block B + l, and in Block B + 3 they 
cooperate to send the v sequence of Block B. 

Decoding is performed as follows. The decoder first decodes 
Block B + 3 without any side-information and thus learns the 
sequence v of Block B. It then decodes Block B + 2 (again 
without any side information) and leams the state sequence w 
of Block B+l. Now that it knows the state sequence of Block- 
B + l, it can decode that block and learn the vi-sequence and 
the V2 -sequence of Block B. From here on, it can proceed with 
the regular backward decoding: in decoding Block b it knows 
the sequences v, vi, and v 2 of Block b and it can therefore 
decode the common message and the messages transmitted 
by each of the transmitters in Block b. From this decoding it 
learns the private messages of Block b, and the sequences v, 
Vi, and V2 of Block 6—1. 

III. The Double- State Scenario 

For the double-state scenario, an inner bound on C™£ was 
proposed in 0. In the absence of cost constraints this bound 
can be described as follows: Let V 1 ^ be the collection of 
all random variables (Vi, V 2 , S x , S 2 , X x , X 2 , Y) whose joint 
distribution satisfies 

Pv 1 ,V2,S 1 ,S 2 ,X 1 ,X 2 .Y = 

Pvi 1 Si Pv 2 \s 2 Ps! Ps 2 Pxi Px 2 Py\s 1 ,s 2: x 1 ,x 2 - (28 ) 
Note that (l28l i implies the Markov relations 

V 2 ^-S 2 ^>-(V 1 ,Y, Sx) 
(Vi,V 2 )^(S u S 2 )^-Y (29) 

and that Xx , X 2 are independent of each other and of the 
quadruple (Vx,V 2 , Sx, S 2 ). Let TZf^ be the convex hull of the 
collection of all rate-pairs (Rx,R 2 ) satisfying 

0< Rx < I(Xx;Y\X 2 ,Vx,V 2 ) - I(Vx;Sx\Y,V 2 ) (30) 
0< R 2 < I(X 2 ;Y\Xx,Vx,V 2 ) - I(V 2 ;S 2 \Y,Vx) (31) 
Rx+R 2 <I{Xx,X 2 ;Y\Vx,V 2 )-I{Vx,V 2 ;Sx,S 2 \Y) (32) 

for some (Vx ,V 2 ,Sx,S 2 ,Xx,X 2 ,Y) <E V^. 

Theorem 3 (/0/J; ft™? C C" d . 
The proof is based on a scheme where lossy versions of the 
state sequences are conveyed to the decoder using distributed 
Wyner-Ziv compression [4| and Block-Markov encoding for 



the MAC, to transmit the messages and the Wyner-Ziv code- 
words. The channel output serves as the decoder's SI in the 
distributed Wyner-Ziv code. Since the two components of 
the source are independent, there is no direct cooperation 
between the encoders via a common message as in single-state 
scenario. Instead, each user spends part of its private rate on 
the transmission of its Wyner-Ziv codeword. 

An improved inner bound was proposed by Li et al. in 0. 
There it was shown that the improved inner bound always 
contains the inner bound of [2], and it was conjectured that 
there are cases where the inclusion is strict. We next present 
the inner bound of Li et al. and then show that the inclusion 
can, indeed, be strict. 

Li et al. consider all joint distributions of the form 

Pv 1 ,V 2 ,S 1 ,S 2 ,X 1 ,X 2 ,Y = 

p Vi I Si ,Xi Pvi \s 2 ,x 2 Psi Ps 2 Pxi Px 2 Py \s u s 2 ,Xi ,x 2 (33) 
and prove the achievability of rate pairs (Hi, R2) satisfying 

Ri </(A-i,Fi;y|X 2) y 2 )-/(yi;5i|Xi) (34a) 

R 2 < I(X 2 ,V 2 ;Y\X 1 ,V 1 ) - I(V 2 ;S 2 \X 2 ) (34b) 
R 1 +R 2 <I(X 1 ,X 2 ,V 1 ,V 2 ;Y) 

-J(^i;5i|X 1 )-J(V 2 ;S2|X2). (34c) 

Roughly speaking, the improvement in the inner bound is the 
result of Transmitter 1 compressing the pair (si,xi) from 
the previous block (with the outputs from the previous block 
serving as side information) and not just si and likewise for 
Transmitter 2. We next show, by example, that the bound of 
Li et al. can, indeed, be tighter than that of Theorem [3] 

The example is very similar to Example Q] In fact, the 
channel is as in Example Q] but with the state Si being null 
(deterministic) and the state S 2 consisting of the pair (Wo, Wi) 
of Example Q] 

Si=0 S 2 = (W ,Wi), (35a) 

where Wo,Wi are LTD binary random variables, each of 
entropy 1/2. 

The rate pair (Ri,R 2 ) — (1, 1/2) is in the inner bound of 
Li et al. To see this we set Vi = and V 2 — Wx 2 with 
Xi, X 2 IID random bits. However, as we next prove, the pair 
(1, 1/2) is not in 7^ n c d . 

We prove this by showing that if (1, R 2 ) is in TZ 1 ^, then R 2 
must be zero. Suppose then that (1,R 2 ) G 71™^. Since Si is 
null, it follows from the structure (128} of the joint distribution, 
that Vi must be independent of all the other random variables. 
Consequently, we can strike it out from ( l30l >, ( 131) , and 
(|32l . Since R ± = 1, it follows from (|30]l that X x must be 
Bemoulli(l/2) and that H(Xi\X 2 ,V 2 ,Y) must be zero. This 
implies that H(Wx 2 \X 2 ,V 2 ,Y) must also be zero (because 
Xi = Yi 8 Wx 2 ). Consequently, H(Wx 2 \X 2 , V 2 , Y t ) must 
also be zero (because Y 2 = X 2 ). This implies that 

H(W X2 \X 2 ,V 2 ) = (35b) 

because X\ is Bernoulli(l/2) and independent of (X 2 , V 2 , W), 
so Y\, which is equal to X\ © Wx 2 , must also be independent 



of (X 2 , V 2 , W). Equation d35bl > is reminiscent of (1 1 Vfb (with 
V 2 replacing V). 

As in Example [T] we now distinguish between two cases 
depending on whether X 2 is deterministic or not. If it is 
deterministic, then the rate R 2 must be zero by PTT l. Consider 
now the case when it is not. In this case Pr[X2 = rj\ is positive 
for all i] G {0, 1}. Since V 2 is independent of X 2 (by d28T), 
and since without changing the inner bound we can assume 
that Pr[V 2 = v 2 ] is positive for all v 2 G V 2 , it follows that in 
this case 

Pr[X 2 =v,V 2 = v 2 ] > 0, f] G {0, 1}, v 2 G V 2 . (35c) 
This combines with (I35bb to imply that 

H(W n \X 2 = V ,V 2 = v 2 ) = 0, rj G {0, 1}, v 2 G V 2 . (35d) 
This implies that 

H(W V \V 2 =v 2 )=0, 77 G {0, 1}, v 2 G V 2 , (35e) 

because, by (l28l . X 2 is independent of (V 2 ,S 2 ) and hence a 
fortiori of (V 2 ,W V ). Thus, H{W V \V 2 ) = 0, and since S 2 = 

(Wo,Wi), 

H{S 2 \V 2 )=0. (35f) 

Consequently, 

I(V 2 ;S 2 )=H(S 2 ) = l. (35g) 
This implies that also 

I{V 2 ;S 2 \Y) = 1, (35h) 

because Y is independent of (V 2 ,S 2 ). It now follows from 
( 135hl >, the fact that V\ is deterministic, and from ( |3~H that R 2 
must be zero. 

IV. Summary 

We have presented an improved inner bound on the capacity 
region of the memoryless multiple-access channel that is 
controlled by an IID state that is known strictly causally to 
the two encoders. This bound contains the bound of [1|, and 
we have provided an example showing that the inclusion can 
be strict. 

We also adapted this example to a memoryless multiple- 
access channel that is governed by two independent states, 
where each transmitter knows one of the states strictly 
causally. The resulting example demonstrates that — as con- 
jecture by Li et al. j3 j — the inner bound of Li et al. can be 
strictly tighter than that of ||2]. 
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